11. Subdags: Introduction and When to Use Them

09 Subdags Intro And When To Use -

SubDAGs

Commonly repeated series of tasks within DAGs can be captured as reusable SubDAGs. Benefits include:

  • Decrease the amount of code we need to write and maintain to create a new DAG
  • Easier to understand the high level goals of a DAG
  • Bug fixes, speedups, and other enhancements can be made more quickly and distributed to all DAGs that use that SubDAG